Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Whisper pipeline: use Sampler #1615

Open
wants to merge 33 commits into
base: master
Choose a base branch
from
Open

Whisper pipeline: use Sampler #1615

wants to merge 33 commits into from
+626 −342

Conversation

as-suvorov
Copy link
Contributor

@as-suvorov as-suvorov commented Jan 22, 2025 •
edited
Loading

Ticket: 152889

@as-suvorov
use decoder interface
68d3e48
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
ade7313
@as-suvorov
remove reshape
b2df4a6
@as-suvorov
use stateful seq2seq barnch
17e3ea7
@as-suvorov
Address review comments
806b01a
@as-suvorov
Rename
e041a33
@as-suvorov
Use commit
9502d9b
@as-suvorov
Set tests reqs
6c30fa4
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
7600072
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
f870a4c
@as-suvorov
Add with_past model tests
e38cf5c
@as-suvorov
remove comment
acc656f
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
aa0f742
@as-suvorov
bump tokenizers
3728884
@as-suvorov
Fix typo
445ce5a
@as-suvorov
Add deprecation message
5bdd695
@as-suvorov
Use sampler for whisper pipeline
7f2a153
@as-suvorov
Add with past decoder
c368401
@as-suvorov
Refactor with past decoder
2e061aa
@as-suvorov
Do not copy encoder_hidden_states if not needed
4eaa9a7
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/sampler_for_wh…
3139a43 
…isper
@as-suvorov
Add stubs
50fb829
@as-suvorov
Remove comment
5021742
@as-suvorov as-suvorov added this to the 2025.1 milestone Jan 22, 2025
@github-actions github-actions bot added category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: whisper Whisper pipeline category: sampling Sampling / Decoding algorithms labels Jan 22, 2025
@github-actions github-actions bot added category: Python API Python API for GenAI category: GenAI C++ API Changes in GenAI C++ public headers no-match-files labels Jan 22, 2025
@github-actions github-actions bot added the category: samples GenAI samples label Jan 23, 2025
@github-actions github-actions bot removed the category: samples GenAI samples label Jan 23, 2025
@as-suvorov as-suvorov requested a review from Wovchena January 23, 2025 10:08
@as-suvorov as-suvorov marked this pull request as ready for review January 23, 2025 10:09
ilya-lavrenov
ilya-lavrenov approved these changes Jan 23, 2025
View reviewed changes
src/cpp/src/sampler.cpp Outdated Show resolved Hide resolved
src/cpp/src/sampler.cpp Outdated Show resolved Hide resolved
src/cpp/src/whisper/models/decoder.cpp Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ilya-lavrenov ilya-lavrenov ilya-lavrenov approved these changes

@Wovchena Wovchena Awaiting requested review from Wovchena

Assignees

@ilya-lavrenov ilya-lavrenov

@Wovchena Wovchena

Labels
category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: whisper Whisper pipeline no-match-files
Projects
None yet
Milestone
2025.1
Development

Successfully merging this pull request may close these issues.
3 participants
@as-suvorov @ilya-lavrenov @Wovchena